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Abstract 

' We calculate the limiting behavior of relative Renyi entropy when the first probability distribution is close 

, to the second one in a non-regular location-shift family which is generated by a probability distribution whose 

' support is an interval or a half-line. This limit can be regarded as a generalization of Fisher information, 

fS) I and plays an important role in large deviation theory. 
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^ ■ 1 Introduction 

, In a regular distribution family, Cramer-Rao inequality holds, and the maximum likelihood estimator (MLE) 
Qi^ ■ converges to a normal distribution whose variance is the inverse of the Fisher information because the Fisher 
(-H , information converges and is well-defined in this family. However, in a non-regular location shift family which 
is generated by a distribution of M whose support is not M (e.g., a WeibuU distribution, gamma distribution, 
or beta distribution), the Fisher information diverges and cannot be defined. Thus, one might think that a 
substitute information quantity is necessary for a discussion of the asymptotic theory. Akahira and Takeuchi 

Ql proposed the limit of the Hellinger affinity ~\og J pg {u!)pg^^{uj) dcu as a substitute information quantity. 
This value is obtained by a transformation from the Hellinger distance. Moreover, Akahira |^ proposed the 
relative Renyi entropy (Chernoff's distance) I'^{p\\q) := —log J p''{uj)q^^'^{uj)duj (0 < s < 1) as a substi- 
I tute information quantity for a non-regular location shift family. This quantity is linked with a-divergence 
' D"{p\\q) := (l ~ JfiP^~ i^) d^j 1 which was introduced by Amari-Nagaoka from an informa- 

'^^ ' . . " . . / 1- 2 \ . 

tion geometrical viewpoint, by the monotone transformation x i-^ — log ( 1 — ^ xj . Since a-divergence is a 

special case of f-divergence introduced by Csisz arQ, which satisfies the information processing inequality, the 
relative Renyi entropy satisfies the information processing inequality 



> 

i> 
o 

O 

::a 

I'{p\\q)>I'{pof-'\\qor') 

for any map /. Moreover, as is shown by Chernoff's formula |^ and Hoeffding's formula the asymptotic 
error exponents in simple hypothesis testing are characterized by the relative Renyi entropy. Thus, it can be 
regarded as a suitable information quantity. 
■ As was proven by Hayashi [Q , the upper bounds of large deviation type bounds are given by these limits of 

^ I the relative Renyi entropies. These upper bounds are outlined in section ^. Therefore, the calculation of these 
limits for the non-regular location shift family is an important topic. These limits can be regarded as suitable 
substitutes for the Fisher information because when the Kullback-Leibler divergence is finite, the relative Renyi 
entropies are connected with the Kullback-Leibler divergence by the relation 

D{p\\q) = lim —^P{p\\q) = lim (q||p). (1) 

s— >1 s(l — S) s^O s[l — s) 

As is known, if a one-parameter distribution family S := {pe\0 £ O C K} satisfies suitable regularity conditions, 
Kullback-Leibler divergence is closely related to the Fisher information Jg defined by (^) as 

\im\D{pg+,\\pg) = ^Jg (2) 
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PBoiduj). (3) 
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However, when the support depends on the parameter 0, the equation does not hold because the divergence is 
infinite. As was shown by Akahira under suitable regularity conditions, the equation 

holds. As the examples in sections 2 and 3 show, there are cases where relation (^) holds, but equation (||) does 
not. The above facts indicate that the limit of the relative Renyi entropy is a suitable substitute for the Fisher 
information in a non-regular location shift family. 

Moreover, in a regular family, since Fisher information is well-defined, the Riemann metric can be naturally 
defined on every tangent space. However, in a non-regular location shift family, as was pointed out by Amari 
Ql, the natural metric on the tangent space is not a Riemann metric, but a general Minkowski metric. Such a 
manifold with a general Minkowski metric on every tangent space is called a Finsler space. Amari [|j proposed 
that to treat the asymptotic behavior of the MLE, we should regard a non-regular location shift family as a 
Finsler space with the Minkowski metric F{6) := lime^o -^(pellpe+e) » , where H is the Hellinger distance. 
Unfortunately, the relation between the MLE and this Minkowski metric has not been adequately clarified, and 
the value of this Minkowski metric has not been calculated. Our result for the case s = ^ gives the value of this 
Minkowski metric. 



2 Interval support case 

In this section, we discuss the location shift family generated by a continuous probability density function 
/ whose support is an open interval (a, b) C M. We assume conditions and (^) for /: 

fi{x) := fia + x) ^ Aix^'-'^ as x ^ +0 (5) 

f^(x) := f(b ~x)^ A2X^^-'^ asx^ +0, (6) 

where ni, k,2 > 0. In addition, if 7^ 1, we assume the following conditions: 

fl{x) ^ Ai{Ki - l)a;'='"2 as a; ^ +0 (7) 

f^'{x)^ A,{k.,-1){k,-2)x'''-^ asx^+OifK, ^2 (8) 

xf'/{x) ^0 as a; ^ +0 if = 2. (9) 

If Ki = 1, we assume the existence of the limits lim^^^+o fii^) lidx^+o fi'i^)- If i^i > 2, we assume that 

Jf-= / r'(x)(/')'(x)dx <^. (10) 



For example, when / is the beta distribution f{x) = B(a ^(^ ~ ■^)'^ ^ whose support is (0, 1), the above 

conditions are satisfied and we have 

Ki=a, K2=/3, Ai= A2^ / . (11) 

In this paper, we denote the beta function by B{x, y). Then, we have the following theorem. 
Theorem 1 Assume that k :— ki — K2, 

1 - K 



hni . = <; Ais + A2il~s) '« = 1 











I'ifoWfo 




— log 




I'ifeWfe 


+e) 


e2 



-{AisB{s + k{1 - s), 1 - k) -I- ^2(1 - s)B{l - s + Ks,l - k)) < k < 1 



Ais(1-s(k-1))_B(s+k(1-s),2-k) . A2(l-s)(l-(l-a)(K-l))B(l-s+KS,2-K) 1 < K < 2 



hm ^ ^iA^+A2)sil-s) 

2 

,s(l ~ s) ^ 

,l™^o ~2 " ^ ^ 



(12) 



where fe{x) := f{x — 0). These convergences are uniform for < s < 1. If ki < K2, substituting n :— ki, 
A2 := 0, we obtain the above equations. 
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The uniformity of < s < 1 is essential for the discussion in Hayashi ||7|. The case k > 2 is an example 
where relation (|^) holds, but relation (^) does not. Note that when < k < 2, in general, the equation 
lini,^+o ^'(f<^y'<^+^) = lime^_o does not hold. 

Proof: Since r{fg\\fe+e) = rif^eWfo), Lemma yields equation (|l2|). ■ 

Lemma 1 For any c G {a,b), we define 

17 {c, f, e) f'-'{x)r{x + e)dx- f{x) dx - f{c)se ~ ^/'(c)e^ 

/+(c,/,e) r ' !^-\x)nx + t)dx^ f' f(^^) dx + f{c)se + {c)e\ 



1 — Kl 

-AisB{s + - s), 1 - Ki) 



< Kl < 1 



lim ^ ' = { -Ais Ki = 1 



Ais(l - s(ki - 1))B{S + Kl(l - S), 2 - Kl) 1 < Ki < 2 



(13) 

lim^-Ml£) 
e^+o -e^loge 2 

/7(c,/,e) .s(l - s) 

lim„ 5 = 2 f'" 2 < Ki 



and 



^ - A2(1-S)S(1-.S + K2.S,1-K2)) 



< K2 < 1 



lim ^ ^ ' ^ ' ^ = <^ -A2(l-S) K2 = l 



^2(1 - S)(l - (1 - s){k2 - 1))B{1 - S + K2S, 2 - K2) 1 < K2 < 2 



K2 

lim^i^iM 

/+(c,/,e) Kl-^) ,+ „ ^ 



hO 



where J ^ and are defined as 

JJ^,:^ £r\x){nx)Ydx, J+^:= I r\x){f{x)fdx. 
These convergences are uniform for < s < 1 . 



(14) 



3 Half-line support case 

In this section, we discuss the case where the support is the half-line (0, oo) and the probability density function 
/ is continuous. Similarly to (||) and (^), we assume that 

fix) ^ Ax""-^ asx^O. (15) 

When K ^ 1, we assume the following conditions: 

f (x) ^ A,{k - l)x'^-^ asx->+0 (16) 

f"{x) ^ A,{k~1){k~2)x''-^ asx^+0ifK7^2 (17) 

xf'ix) ^0 as a; ^ +0 if K = 2. (18) 
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When K = 1, we assume the existence of the hmits \imx-t+o f'{x) and \imx^+Q f"{x). In addition, we assume 
that there exist real numbers c > and e > such that 



r\x){f'{x)fdx<<x^ (19) 

rOO 

/ sup fix + h) sup \f-^{x + t2){f'f{x + t2)\dx<oo (20) 

Jc 0<ti<e 0<t2<e 

oc 

sup f{x + ti) sup \f-^{x + t2)f'{x + t2)f"{x + t2)\dx<oo (21) 

c 0<ti<c 0<i2<e 
/>oo 

/ sup f{x + ti) sup |/"^(a; + t2)/"'(a; + t2)|rf2; < oo. (22) 

Jc 0<ti<e 0<t2<e 

For example, when / is WeibuU distribution f{x) = a(3x°'~^e^^ , the above conditions are satisfied and we have 

K^a, A^aP. (23) 
When / is gamma distribution f{x) ~ rf^2;"^^e''^, the above conditions are satisfied and 

K = a, A = -^ (24) 
r(a) 

Now, we obtain the following theorem. 
Theorem 2 We obtain 

1 - K 



{AsB{s + k(1 - s), 1 - k) <k <1 



hO 



As(l - s{n - l))B{s + k(1 - s), 2 - k) 1 < k < 2 



e^+o — e^^loge 2 



where 







These convergences are uniform for < s < 1 . 

Similarly to Theorem Theorem ^ is proven from Lemma |^ and Lemma ^ 
Lemma 2 i^or a real number c > satisfying (|l9[)-([22|), we define 



We obtain 



, ^ s 



/+(c,/,e):=/ r-^ix)f%x + e)dx^ I f(x)dx + f{c)se+-f'{c)e 



Jt--= r'{x){nx)Ydx 

and the convergence of (p7[) is uniform for < s < 1 . 



(25) 



J/:=/ r^(x)(/')^(:.)d:.. (26) 



hm . (27) 

w/iere 

/•oo 

7+ ._ / ^-l^^^r-fV^^^2 



4 Relation between main results and large deviation theory 

We will outline a relation between Theorems |l] and ^ and large deviation theory only for a location shift family 
{fe{x) := f{x — 9)\9 £ M}, where / satisfies the conditions given in Section |^ or Section |[ This relation was 
discussed by Hayashi Q more precisely. As generalizations of Bahadur's large deviation type bound, we define 
the following quantities: 

ai(6') limsup — — sup inf d(T,6',£) 

02(6*) := sup lim inf ^ inf fiif^O'e) 
f «^+0 g[e) e-e<e'<9+e^ 

P{f,e,e) -ImiM — log f^{\Tn-9\ > e}, 



where T — {Tn} is a sequence of estimators and g{e) is chosen by 

r < K < 2 

5(e) = < -e^loge k = 2 
[ £2 ^ > 2. 

As Ibragimov and Has'minskii Q pointed out, when KL-divergence is infinite, there exists a super efficient 
estimator T such that f3{T, 9, e) and limc_^+o j^(3{T, 9, e) are infinite at one point 9. Therefore, we need to 
take the infimum uiig-^<ce'<e+e into account. Of course, in a regular case, as was proven by Hayashi ||^, the 
two bounds ai{9) and a2{9) coincide. 

If the convergence lime_+o ^ ig uniform for s E (0, 1) and 9 £ K for any compact set iiT C M, 



these quantities are evaluated as 
ai{0)<ai{9) := 

a2[9)<a2{9) 
where /| g are defined by 



2«supn<,<i/|^9 ifO<K<2 
4supo<,<i/^^e ifK>2 

suPo<.<i 7(fey (s^ + (1 - s)^)' 



2/. 



gfi 



info<s<i jijz^ 



if < K < 1 

if K = 1 

if 2 > K > 1 

if 2 < K, 



I''{Pe-e/2\\Pe+c/2) ^ 



> s > 0. 



Note that the uniformity of the convergence concerning < s < 1 is necessary for deriving the above inequalities. 
In Hayashi 0, these inequalities were proven and the attainability of bounds ai{9) and a2{9) was discussed. 



5 Conclusion 

We have calculated the limit of the relative Renyi entropy. As mentioned in Section ^, this calculation plays an 
important role in large deviation type asymptotic theory. On the other hand, we conjecture that these limits 
characterize the asymptotic behavior of the MLE. This relation, though, still has to be clarified. 



A Proof of Lemma |T| 

A.l Asymptotic behavior of (c, /, e) 

In the following, when the limit \\m.^^^Qg{x + e) (lim^^+o ~ e)) exists for a function we denote it by 

g{x + 0) {g{x — 0)), respectively. Our situation is divided into five cases: (i) < Ki < 1, (ii) Ki = 1, (in) 
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1 < Ki < 2, (iv) Ki = 2, and (v) ki > 2. First, we discuss cases (ii) and (v). 



nx+e)-ir{x) + {n'{x)e + {n"{^)- 



+ / [ fix) + f-^{x){n'{x)e + f-^{x){n"{^)- 



dx 



dx 



(28) 



The first term is calculated by 



/(x)+/^-^(a;)(r)'(x)e + r-^(x)(r)"(x)- dx 



f{x)+r{x)se + 



r\x)(,nx)r + -f"{x)\e'\ dx 



fix) dx + fic)es + f'ic)s- - fia + 0)se 
sis-1) 



The term 



f'-'i^) 



r f-\x)if'ix))'dx~y'ia + 0)^ 



r{x + e)-if%x) + if^yix)e + ifri^)- 



(29) 



dx 



goes to uniformly for < s < 1 as e ^ +0. Thus, in case (ii), since /(a + 0) = Ai, we obtain (|13|) and the 
uniformity for < s < 1. In case (v), since /(a + 0) = /'(a + 0) = 0, we obtain ( p^ ) and the uniformity for 
Kl > 2. 

Next, we discuss cases (i), (iii), and (iv). We can calculate /^(c, /, e) as 



f'-%x)f^x + e) dx 



fix + e)- f^ix) + ifn'ix)e+ifrix)- 



dx 



a+S 



^J+s y^''^ ^ f'-'i^)ifi'i^)^ + f'-%^)ifri^)Y ) d^+j f'\^)n^ + ^) 

In the following, wc discuss only case (i). Concerning the second term of (pO|), we have 



(30) 



a+S 



fix) + f'-^ix)if^)'ix)e + f^-^{x)ifri^)^ ]dx+ fix) dx 



a+S 



fix)dx+ / fix)dx] se + 



a+S 



sis -I) 



a+S 



f-\x)if'ix))Ux]e^ + - f"ix)dx 



■ fix) dx + (/(c) - fia + 6))se + (/'(c) - /'(a + 6))'-e^ + '-^^^ f f-\x)ifix))' dxe' 



a+S 



f{x)dx + fic)se+-sric)e^ 
-fia + 5)se-f'ia + S)'-e'+'^^^ 



f-\x)if'ix))Ux]e 



a+S 



(31) 
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Concerning the third term of (30), we can calculate 

i-a+S 



a+S 



f'-'{x)r{x + e)dx- f{x)dx 

<j a 

''^\f-%x)rix + e)^fix)) dx 
f'-%x){n'ix + y)dydx 

Jo Vi^^(y(^ + i)) fiiy) 



a Jo 



dzyf[{y) dy 



(32) 



Since 



Jo 



(1 + 



— — dz = B(ki + S — Kl-S, 1 — Kl), 



using (^) and (|^, we can prove that for any e' > real numbers S > and e > exist independently for s 
such that 



lo fl-'{y{z + l)) f'M 
for e > > 0. For any e' > 0, there exists a real e > such that 

Ioyfiiy)dy . Ki - 1 




— B{ki + S — KlS, 1 — Kl) 



< e 



< e' 



(33) 



(34) 



Therefore, 



h + S — KlS, 1 — Kl) 



< 



fl-%y{z + l)) fiiy) 



Kl 

Soyf'i{y)dy 



sB{ki + S — KiS, 1 — Kl) 



lQyfi{y)dy (1-Ki) 

+ Ai 



Kl 



Kl 



<e' Ai 



(l^Kl) 



Kl 



sB[ki + s — Kis, 1 — Kl) + e' ) < t \ Ai 



e' + sup si3(Kl + S — KlS, 1 — Kl) 
0<s<l 



(35) 



From (|^, (|l]), @, and Q, for any e" > 0, there exist e > and (5 > such that 



/7(c, /,e) - B(ki + s - Kis, 1 - Ki)^ii^e"i 



<- 



a+5 



r-^x) ( r (x + 6) - ( fix) + in'ix)e + ifri^)^ ) ) dx 



a+S 



f-^ix)ifix)rdx e 



(36) 



The first term is less than any e" > when we chose e > to be sufficiently small for S, e" > 0. The 
independence of e > for < s < 1 is shown as follows. For any e > 0, there exists < t{x, e) < 1 such that 

(37) 



fix + e)-[ r{x) + irnx)e + irn^)- ] = irn^ + tix, e)e)- 
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Since 



ifr'ix) = sis ~ i)(,s - 2)r-\x){r)\x) + 3s(s - \)r'\x)r{x)r'{x) + sr~\x)r{x), m 

we can evaluate 



a+5 



a+S 
^3 (-c 



r(2; + 6)- r(:r:) + (r)'(x)e + (r)"(2^)- 



dx 



dx 



{n'"{x + t{x,e)e)^- 
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<- 



f^-\x)nx + t{x,e)e) 



s{s - l)(s - 2)/-^(x + t{x, e)e)if'y{x + t^x, e)e) 



+ 3s{s - + t{x, e)e)f{x + t{x, e)e)f'{x + t{x, e)e) + sf-\x + t{x, e)e)f"'{x + t{x, e)e) 



dx 



O Ja+A-0<ti<€ 



2 sup |/-^(a; + <2)(/')'(2^ + i2) 

0<t2<e 



+ 3 sup |/-'(x + t3)/'(a; + t3)/"(a:^ + i3)|+ sup + t4)/"'(x + 14)| 

0<t3<e 0<t4<c 



(39) 



From the C"^ continuity of /, the coefficient of e"^ at ( p9| ) is finite. Thus, we can show the independence of e > 0. 
We obtain (|l3|) and the uniformity in case (i). 

Next, we discuss cases (iii) and (iv). ki = 2. Concerning the second term of (|30|), we can calculate 



a+S 



/(x) + r-^(x)(r)'(x)e + r-^(x)(r)"(x)- ) dx+ 1^'^' fix) + f^-%x)in'{x)dx 



{f{x) + f'{x)se) dx + 



s{s~l) 



a+S 



f-\x){r{x)rdx]e' + -[ I nx)dx]e' 



a+S 



s{l-s) 



= / fix) dx + (/(c) - /(a + 0))se + (/'(c) - /'(a + S))s- + ^ 



a+S 



r'ix)ifix)rdx e\ (40) 



Concerning the last term of (|3C|), we have 

^s 

f-'{x)r{x + s)dx- 



a+S ft i-yi 



a Jo Jo 
e /-l/l 



Jo Jo 



fix) + f-%x){n'ix)dx 

J a 

f-%x){rY'{x + y2)dy2dy,dx 

p-^iy2z) f"{V2{z + l))f"{y2)f{V2) 



, . f'-'{y2z) f{y2) {f'f{y2{z + i)) 

^ ' f'-^{y2{z + l))f{y2{z + l)) {my2) 



dz 



{f'?{y2] 
f{y2) 



y2dy2 dyi. 



In the following, we consider only case (iii). Since 

+ 2)«("i-i)-2 dz = B{1 + (1 - s){ki - 1), 2 - Ki), 



(41) 



(42) 



using (H), (|7|), and (||), we can show that for any e' > 0, there exist real numbers (5 > and e > such that 



r-%y2z) f"{y2{z + l)ny2)f{y2) 



P~'{y2z) f{y2) {f'ny2{z + i)) 



r-^{y2iz + l)) r'(y2) {f')Hy2) ' 'r-^iy2{z + l))f{y2iz + l)) if')Hy2) 
s(ki - 2 + (s - 1)(ki - 1)) 



dz 



-B(1 + (1-s)(ki-1),2-ki): 



Kl — 1 



< e' 



(43) 
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for e > Vi/2 > 0. For any e! > 0, there exists a real number e > such that 

f'f(y2 



fVi if'f(V2) 

Jo Jo 



y2 dy2 dyi - ^e''^ 



< e 



(44) 



Similarly to (^5|), it follows from ( [43| ) and ( p4[ ) that for any e" > there exist real numbers 5 > and e > 
such that 



C lo lo' f'-'i^)irn^ + V2) dy2 dy, dx + A,B{1 + (1 - s){n, - 1), 2 - ^^),i2^!,i±il^li,,i^l}KL 



< e". 
(45) 



From (gOj), (|0D, (y), and (|44D, we can evaluate 

/7(c, /, e) + A,B{1 + (1 - s){k, - 1), 2 - ^^ yi^-^+(^-^)(-^-^)) 



<- 











Ja+S 





J.,, s(l - s) 



r f-\x){r{x)rdx)e' 

a+S J 



dx 



(46) 



Note that /(a + 0) ~ 0. The first term is less than any e" > when we chose e > to be sufficiently small 
for 5 > and e' > 0. Similarly to (p^), we can show that the choice of e > does not depend on < s < 1. 
Thus, we obtain ( p^ ) and the uniformity in case (iii). 

In the following, we discuss case (iv). Using the conditions (||), (^, and (^, we can prove that for any 
e' > 0, there exist real numbers 5 > and e > such that 

fm ( „ f^^'iviz) /"(y2(z+l) f"iv2)f(y2) I „/„ 1^ f^^'{V2z) f(y2) U')^ {V2(z+l)) \ , „(-\ „\( l^n-,, ^ 



- log y2 



< e 



for e > j/2 > 0. For any e' > 0, there exists a real number e > such that 

j;C-logy2^-£^y2dy2dy,-A,{-^eHoge) 



— loge 

Similarly to (|35|), for any e" > there exist S > and e > such that 

C lo C )"(^ + dy2 dy, dx + A,S^e\- loge] 



— log e 



< e" 



(47) 



(48) 



(49) 



From (gOD, (^, (|4l|), and (|49|), we can evaluate this as 



<- 



1 



'e^(-loge) 



+ Ai^(i-'^e2( 


- log e) 




e2(-loge) 








nx+ 


H 


Ja+S 







dx 



-fia + 5)s'l + iii^ r\x)if'i^)r dx^ 



(50) 



Note that /(a + 0) = 0. The first term is less than any e" > when we chose e > to be sufficiently small 
for S > and e" > 0. Similarly to (^6|), we can show that the choice of e > does not depend on < s < 1. 
Thus, we obtain and the uniformity in case (iv). 
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A. 2 Asymptotic behavior of I^{c,f,e) 

As in Section |A.l| , our situation is divided into five cases: (i) < K2 < 1, (ii) K2 = 1, (iii) 1 < K2 < 2, (iv' 



K2 = 2, and (v) K2 > 2. First, we consider cases (ii) and (v). 



b-e 



b-e 



dx 



fix) + f'ix)se + r\x)ifr{x) 



2 + ri:,)-e^ ] dx 



(^f{x) + f'{x)se + /-i(:,)(/')2(x)fi^e2 + nx)^ 



dx 



{f{b) + f'{b){x-b) + f'{b)se) dx 



r-f) 



nx + e)-[r{x) + {n'{x)e+{n"{x)- 



dx 



6-e 



f{x)+nx)se + r\x){f'f{x) 



s(s-l) 



2 /"(x)^e2 ] _ (^(^ _ 0) ^ j,^^ -Q){x-b) + fib - 0)s. 



The first and second terms are calculated as 



' 'f(x) + f'{x)se + r\x){f'f{x)%-^^ + nx)U^\dx 



{f{b " 0) + f'{b){x -b) + f'{b ~ 0)se) dx 



fix) dx + [fib - 0) - /(c))s6 + (fib - 0) - /'(c))-e' 



+ ( r da: ) fil_ile2 „ f' _ 0) + - 0)(.T - &) + /'(6)se) 



fix) dx - f{c)se - f'{c)-e^ + f{b)se + f'{b)-e^ 
+ { f f-\x){f'f{x) d^ fii-lle^ - fib ^ 0)e + fib - 0)^ - f'{b - 0)se' 



fix)dx-f{c)se-f'{c)-e' 
f fib - 0)(,s - l)e + /'(6 - 0)(1 - ,s)^ + ( r 



,sGs - 1) 



The term 
1 '■'-^ 



f'-'{x) 



f 



r(x + 6)- r(x) + (r)'(x)6 + (r)"(x)- 



/(x) + f'ix)se + /-i(x)(/')2(x)^^V^^' + f"{x)U' ] - ifib) + f'ib)ix -b) + f'ib)se) 



dx 



dx 
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goes to uniformly for < s < 1 as e +0. In case (ii), the continuity of / and the existence of /2(0) and 
/2'(0) guarantee 



f-^{x){f f{x)dx < oo. 



Thus, from the existence of /2(0) and the relation /(6 — 0) = ^2, we obtain (|lj) and the uniformity in case (ii). 
From ( p^ and the relations /(6 — 0) = f'{b — 0) = 0, we obtain (Q) and the uniformity in case (v). 
Next, we consider cases (i), (iii), and (iv). 



b-S 



r{x+e)-[rix) + {rnx)e + {rnx)- 



dx 



b-S 



+ I fix) + ef-^ix){rY{x) + -f-^{x){n"{^)dx 



b-e 



f-^x)rix + e)dx. 



b-5 

In the following, we discuss only case (i). 

rb-5 



fix) + ef-%x)in\x) + -f^-^ix)ifri^) dx + 



b-S+e 



fix) dx 



fix) dx 

^b-5 



b-S+e 



b-S 



fix) dx 



f'-^x)ifn'ix) dx\e+\ f'-^ix)ifrix) dx 



b-5 



= / fix)dx 



b-S+e 

b-S 
b-S 



b-S 



fix)dx+ / f'ix)dx se 



r \s-l)f-\x)if'ix))'dx+'- f ' f"ix)dx\e 



+ 



fix) dx - 
sis -1) ( 



b-S+t 



b-S 
b-S 



fix) dx + ifih -S)~ fic))se + if'ih -6)~ f'ic))-t 



f-\x)if'ix))^dx\e^ 



(51) 



(52) 



Letting z := we have 



b-S 
b 



f'-'ix)fix + e)dx- 



b-S+t 
b 

b-S+e 



Ib-S+e 

{f^-^ix-e)f\x)~ fix)) dx 



fix)dx 



fix) / if'-')'ix + y)dydx 



^ fiiy^) /2(i/(^ + i)) 

Jo my{z + l)) f^iy) 



dzyf2iy)dy. 



(53) 
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Similarly to (pa), we can prove that for any e" > 0, there exist real numbers S > and e > such that 



h B{K2 + S - K2S, 1 - K2j 



^2 



< e 



for e > Vy > 0. Therefore, from (pl|), (|5^), (|53|), and (g^, similarly to ( pq ) we can prove that for any e' 
an real number e > exists independently for s, such that 



/+(c, /, e) + A2B(a^2 + (1 - ,5) - n2{l - s), 1 - 



<e". 



Thus, we obtain ( p^ ) and the uniformity in case (i). 

Next, we consider cases (iii) and (iv). Concerning the second term of (pi]), we have 



6-5 



!{x) + ef'-%x)in'{x) + -f^-^ix)ifri^) dx + / f{x) - nx)if-n\x)e dx 



(/(.t) + /'(x)se) dx + 



b-S 



r-%x)irnx)dx - 



(fix) + f{x)se) dx + f (fix) - r{x){f-'y{x)e) dx 

b-S Jb-S+e 
b / .b-S \ 2 

fix) dx + fib - 0)se - f{c)se + / f^-'{x)if')" [x) dx - 



ifix) + rix)se) dx + f {fix) - r (x)(/i-^)'(a;)e) dx. 

b-S Jb-S+e 



We can evaluate this as 



ifix) + f'ix)se) dx + f {fix) ~ f\x)if^'^)'ix)i) dx 



b-S 
b-S+e 



b-5+e 



pb—S+e pb 

fix)dx— / f'ix)sedx— / f'ix)edx 

b-5 Jb-S Jb~S+e 



b-S+e 

b-S 
b-S+e 



fib-5 + e)- fix)- f'ix)sedx 



<l \fib-S + e)-fix)\ + \f'ix)\sedx 

Ib-S 

< max \fib-S + et)\-e'^. 
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Concerning the third term of (51), we have 



' ' f-%x)r{x + e)dx+ f -f{x)+r{x){f-')'{x)edx 

b-S Jb~S+e 

rix) {f-%x - e) - f-^{x) + (/i-^)'(x)e) dx 

b-5+e 

r (^) r if'-n'i^ + yi) - if-n'i^) dyi) dx 

b-S+£ \ J-c J 

b / ,.0 i-yi 



b-5+e 
e fVl 



e Jo 



"'0 "'0 



+ s{s - 1) 



(1 - .) 



if'-yix + y2)dy2dyij dx 

my2z) /^'(j/2(^ + i))/^'(y2)/(y2) 



my2z) f2{V2) {f^f{y2{z+l)) 



/|(2/2(^ + l))/2(2/2(z + l)) (/^)2(y2) 



U!2?{y2) 
/2(y2) 



2/2 dy2 rfyi 



(58) 



Similarly to ([iq), in case (iii), we can prove that for any e" > there exist real numbers 5 > and e > such 
that 



r(^) (- /°. /o" U'-n^ + 2/2) d2/2 dyi) dx + A2i?(l + S(«2 - 1), 2 - K^) 



(l-a)(2-K2+^(K2-l))e''^ 
K2 



< e 



(59) 



Similarly to (|4^), from (|5l|), (pq), (57), (|5S|), and ([59|), we can prove that for any e" > there exists a real 
number e > such that 



£K2 



Thus, we obtain ( p^ ) and the uniformity i in case (iii). Similarly to (^), in case (iv), we can prove that 
Ls+J'i^) {-l"jTif'~r{^ + y2)dy2dy,) dx + A,^-^e'i~loge) 



e2(-loge) 

Similarly to (|5^), from (|5l]), (|5§), (|^, (|8|), and (|l|), we have 

I+(cJ,e)+A,^eH~\oge) 



< e" 



(60) 



(61) 



e2(-loge) 

Thus, we obtain dl4) and the uniformity in case (iv). 



< e" 



(62) 



B Proof of Lemma @ 



We can calculate 



f-%x)nx + e)dx 



f-%x) fix + e)-i r{x) + {n'{x)e + (r)"(x)- dx 



+ r-^ix) rix) + in'ix)e + (r )"(x)- dx 



(63) 
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The second term of (p3) is calculated as 



r-^x) fix) + ifyix)e+irnx)- dx 



fix) + f'{x)se + f-\^){f')^(:,)±-Jle^ + f"[a:)U' dx 



fix)dx+ I f-\x){fr{x)'-^^j^dx-f{c)se-f'{c)'-e'dx 



dx 



Similarly to (|39|), we can evaluate the first term of ( |63[ ) by 

3 r°° 



f^x + e)^ f^ix) + {fn'ix)e + {frix)- 



I ^^^'P f{x + ti) 

Jc 0<ti<e 



2 sup \f-H^ + t2){f')''{x + h)\ 

0<t2<e 



+ 3 sup \f-\x + t3)f'{x + t3)f"{x + t3)\+ sup \f-\x + U)f"{x + U)\ 

0<t3<e 0<t4<e 



dx. 



(64) 



(65) 



Conditions ( |20| ) - ( p2[ ) guarantee that the coefficient of (|65|) is finite. From (|6^), (|64|), and (|65|), we obtain (^ 
and the uniformity for < s < 1. 
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